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[57] ABSTRACT 

Apparatus and methods are disclosed which are most 
advantageously used in conjunction with a digital com- 
puter to provide improved graphics capability. These 
techniques permit the represenution and manipulation 
of any arbitrarily shaped image in terms of "inversion 
points". Inversion points defuing a region are sorted 
and stored such that the region shape may be regener- 
ated at a later time from the inversion points. Means are 
provided to compare existing regions and new regions 
to be displayed, and region operators are provided to 
specify a precedence between the existing and new 
regions. Thus, new regions arc appropriately "clipped" 
such that only portions of a new region may actually be 
displayed to achieve the desired graphic representation. 

35 Claims, 20 Drawing Fignrei 
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"The Smalltalk Environment", BYTE, August 1981, 
METHOD AND APPARATUS FOR IMAGE page 90, Vol. 6, No. 8. 

COMPRESSION AND MANIPUIATION Although a variety of graphic represenutions are 

desired in Smalltalk or other systems, traditionally large 
BACKGROUND OF THE INVENTION 3 amounts of memory have been required in order gencr- 

. _. J . ate, store and manipulate graphics characters. In its 

Th/present invention relates tc apparatus and mtth- siniplest form, a block of memory may be allocated in a 
ods for displaying graphic information. More particu- data processmg storage system with each memory bit (a 
larly. the present invention relates to date processing ,^ 1 or 0) mapped onto a correspondmg picture element 
apparatus and methods for generating and manipulating '0 (pixel) on the display system. Thus, an entire CRT 
images and date on a display system. screen full of data, in the form of unagcs and/or text^ is 

2. Prior Art represented as either a 1 (black dot) or a (white dot) m 

In the computing industry, it is quite coramon to ablockof memory known as a "bitmap". However, the 
represent and convey information to a use; through use of a one-to-one correspondance between the bitm^ 
graphic representetions. These represenutions may " and the CRT display requires a significant amount of 
take a variety of forms, such as for example alphanu- storage space within the computer's core memory- In 
meric characters, cartesian or other coordinantc graphs, addition, the generation and manipulation of an image 
as well as shapes of well known physical objects, etc. or character requires that virtually all bits in the bitmap 
Historically, humans have interfaced with computers be updated after any modification to an image or the 
through a system of discrete commands which typically 20 jjj^g -pj^j procedure is both repetitive and time consum- 
comprisc a combination of both text and mathematical ing, and significantly hampers the practical use of inter- 
symbolic characters. Examples of such systems are active graphics display operating systems, 
numerous and include the programming languages of One method ofproviding the necessary graphic capa- 

Fortran, Algol, PL/1, Basic, and Cobol, which trans- bilities, for systems such as Smalltalk, is "BitBlt" (Bit 
form a given set of user commands into machine execut- 25 g^y^jj^y gjock Transfer) as developed by the Xerox 
able "object" code. Learning Research Group, Palo Alto Research Center, 

However, the case with which a user becomes profi- p^^ y^f^ caljf ^^^ jr, i„ga]is^ -xhe Smalltalk Graph- 
cient in programming or interacting with a computer ^^ Kemal," BYTE, page 168, August 1981, Vol. 6 No. 
based system ii generally a function of how close the g gj^gj. mjji^es regions which are themselves small 
system models the logical thought of the user himself. If 30 ^^^^^^^ ^^ ^^^^ ^:^^^^ ^^^^^ such as for example an 
the user is able to enter commands m the order m which ^^^ ^^^^ ^j^^p^ ^^ to be used as a cursor, a pat- 
he would find most logically appropriate, rather than ^^ ^^ gj^gj^ ^ ^jj, ^ discussed more fully below, 
having to transpose his desired command into the code 4^^^^^ characters from a source bitmap; such as for 
of a programming language, greater user effeciency m ^ ,^ ^ font fUe of characters, to a destination bitmap 
using the system is achiev^ ^ , _, , • ..„^ (i.e. ,t block of memory to be displayed on a CRT) at 

One system which has been developed to mmmiue ^ coordinates. By Lncorporati.ng the use of a "clip- 
the leammg and acclamation penod which a user must ^ .ectengle" which limits tn. region of the destina- 
go through m order to become proficient m the mterac- l^^^^ \^^^^ ^ ^ effected, a portion of a larger 
tion with a computer system « frequent y referred to as 1^^^ ^ P. , ^^^^ , ^„dow such that only that 

an "object-onented" or "Smalltelk system, ^e Small- 40 ^ tr^sferred scene which falls within the 

telk approach is to replace many common coded pro- P« « transferred. In addition, a variety of 

grammmg commands with two-dimensional graphics winaow wm «c iia.i» t , ' 

Ld animation on a computer display. Quantitatively, it transfer operations are provided jh'fj^n'rol «h^ 
has been found that sinJe people readily think in terms combinauon of a transferred ^J'^^^^^^t 
of images, a person can ateorb and manipulate informa- 45 existing scene P^^^^'^'y **°^«* " /J« .f^*^^"" ^^^ 
tion presented in a visual context much faster than if -nap. However, the BitBlt system « Imuted «» terms of 
represented by text. The particular type of graphic the typ« of images which can be transferred and iMmp- 
mterface by which the user interacts with the machine ulated. Specifically^.tBlt is constramed to transfers of 
mav varv for anv eiven aoolication rectangular areas. This hmitetion sigmficanUy restricts 

One S^immoTsraJlt^k tS^ approach utilizes 50 its use as a graphics tool since BitBlt is thereby unable to 
multiple "windows" displayed on a cathode ray tube transfer date to overlapping wmdows or *<= ""• ta 
(CRT! in which combinations of text and graphics are addition, large amounte of memory are required for the 
used to convey information. For example, euch window BitBlt system. Other hmitetions m pnor art systems, 
may take the form of a file folder, of the type used in a such as BitBlt, are described m this Patent m order to 
standard filing cabinet, overiapping other folders, with 55 more fully identify the nature of the present invention. 
the "top- fully visible folder constituting the current As will be disclosed below, the present nivention 

workfile. A user may add or delete information from a provides a means whereby any arbitrarily shaped region 
file, refile the file folder in another location, and gener- may be defmed and stored usmg sigmficantly less mem- 
ally operate on the filt just as if an actual file in an office ory than was previously possible m the prior art. Addi- 
was being used. Thus, by graphically presenting an 60 tionally, the present mvention provides a meaM 
image which represents the object of the user's com- whereby operations may be performed on regions efB- 
mand, and allowing the user to operate on and manipu- ciently and quickly by a digital computer, 
late the image in substantially the same way he would as SUMMARY OF THE INVENTION 

if the image constituted the actual object, the machine 

becomes easier to operate to the user and a stronger 65 The present invention provides methods and appara- 
man-machine interface is achieved. See, for example, D. tus which arc most advantageously used in conjunction 
Robson. "Object-Oriented Software Systems", BYTE, with a digital computer to provide improved graphics 
August 1981, Page 74, Vol. 6, No. 8; and L. Tesler, capabiUty. These techniques permit the representetion 
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and m^nipuUtion of wy Mtitrarily defined rfgion in FIOS. 4<«H0 i!I"«tr.te operations on «8"on? ««»« 

tenns of "Inversion Points". An inversion pc.uil is by inversion poinU wliich may be accomplished using the 

definition 5 point at which the state of all points having present invendMi. , — • » . ~-i«» 

coorfinatesw the right and below the subject point we FIG. 5 il ustrates the process of convertmg a re^ 

S^St^g. binary zeros are converted to biiiry ones 5 defined by inversion pomU «to a one «am hne buffer 

and visa versa). A "Region" is defined as any arbitrary scwning vcrticaJ y down "region. „„^h«„ 

^ which Jy includf a number of groups of disjoint FIG. 6 symbohclly llu^t" «he AMO operation 

„ L I. r-. ..-__u ._ "I" between two recions one scan line at a tune, 

areas. Thus, any shape, such as for e«mpk an L "^^^ symlSucal-y illustrates the operation of a 

shape is treated simply « wiother repon to be defmed ^- ^^^^^^^^ „^ portioiTof a sou«* 

and operated on. By defimng a set of inversion po-Jits 1° " • P.^\,vJ7~r ' *^ 

for any given region.au of the poinJ^wWch 00^^^^^ "??a*^s^SXfllustratestheuseofone«*nline 

the region need not ^/'^'^^.'^ ^^nl^^^^oS. «>"ff" ««d Vscan line mask to selectively mask portions 

the inversion pomts defining the region need be stor^ ^ .^ ^^^^^ ^ ^^ destination 

Briefly stated, in accordance with one typical em- j,j„p^ f^^ display 

bodiment of the present invention, there I* provided ^P ^ aiusuat« the result of one implimentation of 

means for generating an mput r^resentabon of a re- ^^ ^^^^^ invention using the inversion point scan line 

gion, which may comprise any arbitrary shape or area ^^ system 

the perimeter of which need not be a continuous curve ' 

and may include disjoint areas. This input representa- ^ NOTATION AND NOMENCLATURE 
tion is .liost advantageously coupled to a digital com- ^^^ detailed descriptions which foUow are presented 
puter. On.:* received, the digital computer determines jj^rggiy {„ terms of algorithms and symbolic representa- 
the position of the inversion points needed to define the ^^^ ^j. operations on data bits within a computer mem- 
region and sorts the points left to right and top to bot- ^^ These algorithmic descriptions and representations 
torn in accordance with their coordinates in the region, ^j ^j.^ ^^ means used by those skilled in the daU process- 
Algorithm means are provided to transfer fjid operate -^^ ^^^ ^^ ^^^^ effectively convey the substance of 
on regions (or portions thereoO within the computer ^j^^^ ^^^.j, ^^ others skilled in the art 
memory and to display a resulting region on an appro- j^ algorithm is here, and generally, conceived to be 
priate device, such as for example a cathode ray tube ^ self-consistent sequence of steps leading to a desired 
(CRT) or the like. 30 result These steps are those requiring physical manipu- 

A scan line mask comprises a one scan line buffer, lations of physical quantities. Usually, though not neces- 
which in binary form represents existing regions which sari]y, these quantities take the form of electrical or 
are currently being displayed and stored in a destination magnetic signals capable of being stored, transferred, 
bitmap. The destination bitmap comprises a block of combined, compared, and otherwise manipulated. It 
memory in which each bit corresponds to a pixel or the 35 proves convenient at times, principally for reasons of 
like on the display device. The scan line mask vertically common usage, to refer to these signals as bits, values, 
scans down and "slices" the existing regions into hori- elements, symbols, characters, terms, numbers, or the 
zontal rows corresponding to each raster line on the iji^g, it should be borne in mind, however, that all of 
CRT display. Similarly, data from a source bitmap or ^^^ ^nd similar terms are to be associated with the 
font file, in the form of characters or the like, to be 40 appropriate physical quantities and are merely conve- 
added to a portion of the destination bitmap is also njent labels applied to these quantities, 
"sliced" and placed into a horizontal scan line buffer Further, the manipulations performed are often re- 
corresponding to each raster scan line of the CRT. As ferred to in terms, such as adding or comparing, which 
one horizontal scan line is transfered from the source are commonly associated with mental operations per- 
bitmap or the like to the destination bitmap, the contents 45 formed by a human operator. No such capability of a 
of the source scan line buffer are compared to the con- human operavor is necessary, or desirable in most cases, 
tents of the scan line mask, such that the source scan line in any of the operations described herein which form 
is "masked" and only selected portions of the source part of the present invention; the operations are ma- 
buffer are transferred to the destination bitmap. By chine operations. Useful machines for perfoiming the 
using a variety of region operators, precedence between 50 operations of the present invention include general pur- 
existing and new regions may be specified. Thus, a pose digital computers or other similar devices. In all 
pattern (such as for example striped, checked or the cases there should be borne ir mind the distinction 
Uke) may be added to an existing region, text may be between the method operations in operating a computer 
overlayed, scrolling of text within a region may be and the method of computation itself. The present m- 
easily accomplished, and numerous other graphics op- 55 vention relates to method steps for operating a <»m- 
erations may be completed. ' puter in processing electrical or other (e.g., mechanicj^ 

The resulting destination bitmap is converted to sig- chemical) physical signals to generate other desired 

nals which are then applied to a CRT or other display physical signals. 

device, and tiie image is displayed in a conventional The present, invention also relates to apparatus for 

nianner. 60 performing these operations. This apparatus may be 

specially constructed for the required purposes or it 

BRIEF DESCRIPTION OF THE DRAWINGS ^^ comprise a general purpose computer as selec- 

FIG 1 illustrates a computer incorporating the prcs- tively activated or reconfigured by a computer program 

ent invention stored in the computer. The algonthms presented 

no 2 shows a typical arrangement of program stor- 65 herein are not inherenUy related to any particular com- 

age Ln the system of RG. 1. putcr or other apparatus. In partiojlar, various genwal 

nCS. XcXh) tUusti^te the use of inversion points to purpose machines may be used with programs wnttcn 

defme a region. ™ accordance with the teachings herein, or it may 
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prove more convenient to construct more specialized HG. 2 shows a typical arrangement of the major 

apparatus to perform tl e required method steps. The progrwns contained within the memory 26 illustrated m 

required structure for a varitty of these machines will HG. 1. In particular, there is shown a video destination 

appear from the description given below. bitmap 3H, which in the presenUy preferred embodi- 

*^' 5 ment comprises approximately 32 kilobytes of storage. 

DETAILED DESCRIPTION Yius destination bitmap represents the video memory 

TTie foUowing detailed description will be divided for the dispUy monitor 34. Each bit in the destination 

into several sections. The first of these will treat a gen- bitmap corresponds to the upper left coordinate of a 

eral system arr«igement for generating computer ^f"'^'''^'2,^P'^'^'>''t^^'^^y??^J^J^ 

graphic. Subsequent sections will deal with such as- 10 destmation bitmap can be des^ibed bya ^voKhmoa- 

Jectt of the pSent invention as defining m inputted »onii array of pomte having loiown coordmates. Of 

Sn in terms of invenrion points, the «,rting of inver- course, m the case '*'^^'' ^'^^^'^^^l'^^^^*'^^ 

sion points, operations on inversion points, generation »»ch «s for e«mple a prmter ^^ *« '•^'l *^"^*«^f 

wuii J/V/U.W.. »/p». .Jl..,/-^ „.^™.i«™ the bitmap 38 would represent the data pomts to be 

of a scan Ime mask, and region transfer operations ™* .*i»u^K , _• ,*^ .. , j • »# t£ 

oi a »taui luic iii«., e 15 displayed by the particular display device. Memory 26 

among others. j_„^.,»:„„ „„„.„„„. also includes programs 40 which represent a variety of 

In addition, m the foBowmg ^^escnpUon^ num«ous of iLSL for execution by the CPU. For 

specific details are set forth such as a^gonthimc conven- ^ fanplimenting the opera- 

tio.«. spedfic numbers of bits, etc m «rder to provide ^^PJ^ ^^^^ desLlK thi^ Patent, monitor «d 

a thorough understandmg of the prwent mvent^on. programs, disk operating systems and the like 

However, it wUl be obvious to one skiU«l m the art that .^ LrS^thin this memoTy location, 

the present mvennon may be pracuced without these ^^^ ^ ^^ ^^^^ comprise regions, fonts, 

specific details. In other mstanccs, well-known circmts ^^ structures, coordinates and characters are also 

and structures are not descnbed m deu.il m order not to ^^^ .^ memory 26, or may be temporarily stored in 

obscure the present mvention unnecessarily. ^ ^^^^ memory onil 32 as may be required in any given 

GENERAL SYSTEM CONFIGURATION application of the present invention. Additionally, space 

within memory 26 is reserved for other programs and 

FIG. 1 shows a typical computer-based system for ^^^ memory which is designated at 44. These other 

generating computer graphic images accordmg to the programs may include a variety of useful computational 

present invention. Shown there is a computer 20 which j^ ^ ^,^^^, programs as may be desired, 
comprises three major components. The first of these is 

the input/output (I/O) circuit 22 which is used to com- INVERSION POINT REPRESENTATION OF 

municate information in appropriately structured form DEFINED REGIC NS 

to and from the other parte of computer 20. Also shown -pjjg present invention represents any arbitrarily de- 

as part of computer 20 is the central processing unit jj j-m^^j region in terms of "inversion points". In addition, 

{CPU) 24 and memory 26. These latter two elements are jjjp present invention defines a "region" to be any arbi- 

those typically found in most general purpose comput- jjary area which may include a plurality of disjoint 

ers and almost all special purpose computers. In fact, areas of any shape or configuration. Referring now to 

the several elements contained within computer 20 are piQ_ ^a), an inversion point 40 is illustrated. An inver- 

intcnded to be representative of this broad category of 40 sjon point is, by definition, a point at which the state of 

data processors. Particular examples of suitable data gn points haviag coordinates to the right and below the 

processors to fill the role of computer 20 included ma- inversion poinr are inverted. Thus, as depicted, all areas 

chines manufactured by the Apple Computer Co.. Cu- to the right ard beiow the point 40 are dark since point 

pertino, Calif. Other computers having like capabilities 40 was defined on a fM-eviously white background. In 

may be of cour% be adapted in a straightforward man- 45 terms of the physictl implementation of the inversion 

ner to perform the several functions described below. pojjit system, the position of an inversion point is de- 

Also shovra in FIG. 1 is an input device 30, shown in scribed in terms of its coordinates in a memory bitmap, 
typical embodiment as a keyboard. It should be under- As illustrated in FIG. 3(6). a vertical un'jounded strip 
stood, however, that the mput device may actually be a results when two inversion points, 40 and 42, are de- 
card reader, magnetic or paper tape reader, or other 50 fined on a bitmap such as destination bitmap 38, and 
well-known input device (including, of course, another subsequently displayed on monitor 34. The addition of 
computer). A mass memory device 32 is coupled to the the point 42 on the bitmap inverts the state of all points 
I/O circuit 22 and provides additional storage capabU- having coordinates to iu right and below it. cancelling 
ity for the computer 20. The mass memory may include the effect of point 40 within this area and thereby defm- 
oiher programs, fonts for given characters, and the like 55 ing a darkened vertical strip. 

and may take the form of a magnetic or pcper tape Similarly, four inversion points 40, 42, 44 and 46 

reader or other well known device. It will be appred- defme a square or other quadrsurle as shown in FIG. 

ated that the daU retained within mass memory 32. 3(c). As illustrated in FIGS. 3(//) aad l«) ^i*>« «r<^ ^X 

may, in appropriate cases, be mcorporated in standard be defmed using inversion points, and voids within a 

fashion into computer 20 as part of memory 26. 60 given shape may be easily generated. In addition, it will 

In addition, a display monitor 34 is illustrated which be apparent that any given region may contain any 

is used to display the images being geneiated by the number of disjoint areas, as shown in FIG. 3(/). inas- 

present invention. Such a dispUy monitor may take the much as all shapes within a region are simply defmed by 

form of any of several well-known varities of CRT the coordinates of the inversion points, 

displays. A cursor control 36 is used to select command 65 Moreover, circular and other non-linear regions may 

modes and edit graphics data, such as for example a be defined by proper positioning of inversion points, 

particular image, and provides a more convenient With reference to FIG. 3(g). a diagonal line 43 may be 

means to input information mto the system. defmed between points "X" and "Y" by a step scries of 
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two inversion points between -JTand "Y." Although . '^}"^'^ F^'^ ^^ "^ J^X^""^ 2^^^,^ 
direct dugonalline between points v/ould be preferred. the pomt m questwn (pomt "I m FIG. 4(<i)), wd the 
the physiMl structure of the raster line display monitor inversion poinf« horizontal coordinate is less than that 
S dSm irmit this. Each pixel on the CRT display of point "F'. a variable is "toggled" which « ether true 
occupies a unit area between given coordinates, where S or false (and which was onginally set, for example, to 
by convention a particular pixel is accessed by the coor- false). Thus, each time and mvenion point above and to 
dinate of the end point which lies at its top left Thus, a the left of the point m question is detected, the state of 
stci>-like function of inversion points defining a series of a tnic/falsc variable is switched. If after scanning 
horizontal line segments is required to approximate a through the list of inversion pomts defining the region 
diaijonal ii.i- •" *' variable is true (i.e. an odd number of state changes 

It will be"s'>preciated that once any given region is occurred) the point in question fi-e. point "P") Hm 
defined in terms t>f its inversion points, in general o:ily within the particular region. Howevo-. if the variable u 
the inversion poLnts need be retained in memory 26, false fi.e. zero or an even number of state changes oc- 
unlike many prior art systems which require that virtu- curred) the point is not within the region. Thus, a quick 
ally all poiiiis comprising an image be stored. In the 15 and efTidcnt method for deternumng pomt membership 
pr«ently preferred embodiment, a region is catered using inversion poiaa is provided by the present inven- 
into the computer 20 by a user by means of cursor con- tion wnich was not possiolc m the pnor art 
trol 36 or other irput device. The positios of the inver- REGION TO SCAN LINE BUFFER 

sion points defining the region is determraed by detect- TRANSFORMATION 

iac horizontal line segmenU which in part form pomons 20 , ^ . ,• t- 

of the imputied region. With reference to FIG. 3(A), line The present mvenoon-s use of ordered hsts of mver- 

s'-pments 80 85 90, 100 and 125 are thus identified. sion points provides a straightforward means of repre- 
Inversion p<iints are then defined at the coordinates scnting the contents of Mch raster scan bne on monitor 
corresponding to the end points of each line segment, 34. Referring now to FIG. 5, portion of memory 40 (See 
Uierebrdefining the entire region in terms of its inver- 25 FIG. 2) is allocated as a one scan hne buffer In the 
TnSiZ Vertical line segm«ts within the region are presently preferred «nbodm.«.t th« ca, hne-buffer is 
ienored since they will be generated automatically, by sufficiently large such that each honzonttl row of pixels 
definition, using the previously described inversion on th.e CRT monitor screen or other output device is 
point convention. TTie specific sequence of operations represented by a bit Wiethe buffer. A region which 
which are required to be executed by computer 20 to 30 has been previously defined m tenns of an ordered hst 
detect and isolate horizontal line segments, will be ap- of inversion points may be represented by bit states 
parent to those sldlled in the data processing arts, and within the scan line bi^er^ For ev^ hoiizontal row 
will not be set forth in this description. The inversion displayed en momtor 34, designatoi Vo. vi, v: ... 
points of a region are sorted into an ordered list of V,+ , in HG. 5, inversion pomts having vertical coordi- 
^ints in a left to right, to? to bottom order in accor- 35 nates corresponding to the particular honionts^ row 
dl-.ce vvith their coordinates. For example, with refer- which is scanned are represented by an alt«ed bit state 
ence to the re,;ion of FIG. 3(.) the hst of mversion (i.e. a ! in an ongffl:i! scan me fi='^°f «/> ''^fPP^^ 
points in acccrriance with the convention would be as coordmates on the scan hne buffer. AU bits between 
follows- 54 56 5?, 60, 62. 64. 66, 68. 70. 72. 74, 76. pairs of inversion points m scan Ime 155 are then m- 

It has been found, that the use of the above conven- 40 verted, such that a tnie representaoon of the region to 
tion pennits simplified operauons on regions such as be displayed is gt^erattd frtjm the inversion PO«nt w- 
those aiustrated m FIGS. 4(cH<?). Typical o-rations dered hst Ttus, as shown m FIG. 5, by scamimg 
which may be pcrfonned using the present invention's through each honzontal row to be ^^y^^^J.^^^ 
use of ordered ILns of inversion poinU are the functions gion may be honzonially and sequentially sbced mto 
of the determinaticn of point membership, as well as the 45 segments one scan line wide. ,-,... 

intersection, union, differerence. and exclusive-OR of As wiU be discussed below, the me of a smgle nirt«r 

regions «=*° ^"^^ buffer allows a region to be transferred from a 

Frequently, in the course of a graphics operation, it is source bitmap 42 to the destination bitmy ^ "^ ^^i 
neceaary to detcnnine if a point in the destination bit- propriately "masked" such that any arbitrary region 
map 38 (and thereby correspondingly dispUyed on the 50 may be transferred and ^^P'^^'^,^^ ^^^^ 
display monitor) lies wixmn a particuUr region. This systems such as BitBlt which are confined to rcctangu- 

function is generally referred to as "point membership". lar region transfers. . ...... .v .^ ,„ 

Traditionally, the detennination of point membership In addiaon, it will be appreciated that the region to 

required rather exterisive daU manipulations and ca'cu- scan line buffer transfonn is reversable. Once a region is 
latio-is. For example, one prior art method of detennin- 55 represented in the fonn of a one scan I'M buffCT, an 
ing -oint membership was to calculate and sum the ordered set of inversion pomte may be r^rfmed t)y 
anglM from the point in question to the region of inter- locating inversion states on the buffer as the buffer scans 
est If the sum of the angles equals 360 degrees then a region from its top (Vj) to bottom (V,+ i). inversion 
point membership within the region exisu. It will be point positions arc located easily inasmuch as an mver- 
appreciatcd that tiiis particular method of detennining CO sion point position on tiie buffer is that pomt where a bit 
point membership requires numerous and repetitive state change is sensed fi.e. a 1 where the next bit is a uj. 
olculations and is extremely time consuming. More specificaUy, in the present emb«imient the loca- 

However, the present invention's use of inversion tionof in version points may sunply be detenmned by an 
points provides an efficient means to detennine point exclusive-OR operation between the current scan hne 
membership. With reference to FIG. 4{a). the present 65 (e.g.. V3) buffer contents and the previous (e.g.. Vj) 
invention scans through the previously ordered list of scan Une buffer contents. Thus, the portions of regions 
inversion points defining the xrgion in question, from which remain unchanged between suteequent verti«^ 
top to bottom. If an inversion point has a vertical coor- scan line positions are ignored inasmuch as a unifonmty 
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of content between one vertical scan line position and sorting the inversion point lists of regions "T" and "IT 

the next would indicate that no inversion points are ofFIG.4(*), and discarding any poinu having the same 

present In addition, horizontal positions of inversion coordinates in both regions. In other words, computer 

points may then be determined by shifting the resulting 20 simply treats the ordered lists of inversion pointe 

exclusive-OR ed scan line to the right by 1 bit, and 3 defining regions "T" and "U" as one large list, and sorts 

effectuating aacther exclusive-OR operation. For ex- gllof the inversion points, left to right and top to bottom 

ample, ifafter the exclusivc-OR operation between scan j„ accordance with the previously described conven- 

line buffer V„ and V,_ i the result was 01 1 iOOl 1, then tio„ fh^ resultant list of inversion points represents a 

by shifting the result to the right one bit and completing region whose points are contained either in region "T" 

another cxclusive-OR operation we obtain: 10 ^^ ..y b^t not both. 

It will be appreciated that numerous other operatioiis, 

01 j lOon ^ and combinations c-f operaticns, usisg the present invcn- 

oiooioio - iavertion'^i'^uom ^or scm line >*, " tjon's inversion point and scan line buffir method may 

be performed on arbitrary regions that was possible m 

The specific commands to be executed by computer prior art methods. 

20 in order to determine where in a scan line buffer a SCAN LINE MASK 

state change exists wiU be apparent to one skilled in the . 

art, and will not be further described. With reference now to FIG. 7. the present mventwn s 

,» use of a scan line mask to provide arbitrary region clip- 

REGION OPERATORS ^ ^^^ ^ symbohcally illustrated. A previously defmcd 

The present invention's use of a one scan line buffer region 160 which has been converted into an ordered 
to systematically represent the contents of regions per- list of inversion poinU is used as a "mssk" to which all 
mits the previously described ojierations of union, inter- additional images to be displayed on the monitor 34 are 
section, etc., to be easily accomplished. For example, jj compared, prior to affecting the destination bitmap 38. 
the intersection .jperation illustrated in FIG. 4(6) pro- As shown in FIG. 9, it is frequently desired that multi- 
vides an inversioc point representation of the shaded pjg regions overlap with some predeterminsd prece- 
area, and is obtained by executing an "AND" of the two <jence. As is illustrated, folders may be depicted as over- 
overlapping regions "A" and "B." Referring now to lapping, text may be provided on each displayed folder, 
FIG. 6, a one scan line buffer is defuied for each region ^ ^^ ^.^^ arbitrary regions may be displayed. However, 
"A" and "B." For each horizontal raster row of the ^ discussed above, prior art methods such as BitBlt are 
CRT display, the respective scan line buffer represents constrained to rectangular "region clipping". This, the 
each region's contents in binary form. The contents of versatility of prior art systems is severely Umited by the 
the scan line buffers are then operated upon m order to ^^^1^^^ of operating on rectangular regions only, and 

accomplish the 'l«'rf.;'^f"°±,, " '^%';?«:°„J",*^^ 35 their inabUity to selectively affect regions other than the 
4{*). the contents woidaoe "AND ed together »^r«^ ^J^^^^ j^,^^^ 

m a composite scan ime. For example, .f for vertical ^^ symbolically iUustrated in RG. 7. other regions 

posiuon Vi: ^^^^ ^ patterns or characters are complied to a bitmap 

••A-KMiine-iiiiiiOO "mask", one scan line at a time, of existing regions 

*0 which are currently being displayed. As vidll be dis- 
-B" win line- loaioooi cussed below, by defming region operators various 

masking priorities may be defined. Thus, patteras may 

Then the composite scan line after an "AND" opera- 5^ provided as well as fonts and other characters within 
tion would be: lOOlvXXX). In addition, the identical any arbitrary region. "Region clipping" is provided in 
"AND" operation is done for each horizontal row V, 45 accordance with the region operators such that portions 
comprising each region. The result of the above opera- of overlapping regions are selectively displayed, 
tion being a composite representation, one scan line at a Referring now to FIG. 8, each source bitmap 42 

time, of the resulting intersecting shaded region "C" of which may comprise an image, character, font or the 
FIG. 4{6). The portion of the inversion points compris- ^^ which is desired to be displayed is "sliced" and 
ing the shaded region "C" may then be extracted using 50 transformed into a one scan line buffer in accordance, 
known techniques, such as the exclusive-OR operation ^^j^ j.^^. gjjample, the above discussion under the head- 
previously described. ^ "Region to Scan line Buffer Transformation." Thus, 

Similarly, an "OR" operation bctw«ai the two re- ^.^^ ^^ ^ displayed is represented by a one line 

gions is utilized in order to achieve the union function of ^^^^ ^^^^ horizontally scans the source bitmap 

FIG. m. To obtam the "Difference of ITG^dX the 55 ^ representation of the source 

operation between the two regions xyould be (NOT P expansion of inversion point positions 

"S") AND "R", wherem the state of a,i binary quanU- 'cgiuu uy yyjy^y^ 

ti« repre.ented_,^tjjn the J -^ Ime buff^ is m- '^-^^^^"oS'which are presenUy being displayed 
verted pr :or to AND mg the contc.ts with the R ^ ^^^ ^ ^.^^ „^^^,. ^^^^ ^ ^^^^ ^^ ^^^^^ ^ 

*T.-Sry. thfexclusive-OR operation of FIG. 4(e) is be displayed are compared. As ^^ do!« -i'h the -ew 

simply achieved by j^rfonning the exclusive-OR on «>«rce regions to be added, the e«stmg d«Play^e- 

each region's scan line buffer contents, in the same man- gom is transfortned mto a one scan Ime mask represent- 

ner as was done in the above example of the "AND" ing the contents m binary form of the destmation re- 
operation. However, it wUl be apparent to one skilled in 65 gion. Depending on the transfer mode operation speci- 

the art that the present invention's use of ordered lists of fied, each scan line of the new region is selectively 

inversion points renders the exclusive-OR operation transferred to the destination bitmap 38 and displayed 

trivial. The operation may be accomplished by merge on the display monitor 24. 



Page 0013 of 0016 



Apple Computer Inc. Patent : 4_622_545 



11 



4,622,545 



The speciflc type of transfer mode operator used is a 
function of the desired output. Region operators include ' 
the functions of OR, AhfD, cxclusive-OR, NOT as well 
as any combination thereof. For example, if the cunrent 
scan Mne mask for row Vi on the CRT contains 5 
01 lOlOlO and the current source scan line buffer for Vj, 
conUins 01 1001 10 then the result after an "AND" oper- 
ation which would be displayed on monitor 34 would 

01 lOIOlO - loii line muk boflo- ooauiitt 

(AMP) 01 100010 - iource Kan line iHifTer contenu 

OllOOOtO - dettiiution bitnutp ku line contentt 

lo be displayed 

Thus, it will be appreciated that not all portions of the 
new source region will be transfeired to the display 
device, and is thereby "clipped" depending on the par- 
ticular transfer operator chosen. In addition, it will be 
noted that the particular shape of the regions being 20 
operated upon is irrelevant to the method of the present 
invention. The use of inversion points and one scan line 
buffers allow any arbitrary region to be defmed, masked 
and transferred by the present invention. 

In the presently preferred embodiment, three sepa- 25 
rate scan line mask buffers are provided to which a new 
source region is compared. A "user region" mask com- 
prises the existing region being displayed which the 
new region, if transferred, will affect. A "visible re- 
gion" mask is defmed as the visible portion of the exist- ^ 
ing region currently being displayed (e.g., folder 200 of 
FIG. 9). The "clipping region" comprises the visible 
portion of the user region to which the new souro: 
region will be "clipped", such that only a portion of the 
source region is transferred. Thus, a new source region 
to be transferred from thr source bitmap 42 to the desti- 
nation bitmap 38 is passed through the equivelent of 
three scan line mask buffers. In practice, each scan line 
mask is "AJJD" ed with one another and the composite 
scan line mask is then utilized to mask new regions. 

With reference to FIG. 9, an example of an output 
displayed on monitor 34 in accordance with the present 
invention is illustrated. Region 200 was originally de- 
fined by a user and stored ii? memory 26 as an ordered ^j 
list of inversion points. By specifying a proper region , 
O]>erator as described above, regions 210 and 240 have 
been displayed such that it appears that region 200 lies 
between regions 210 and 240. Similarly, text has been 
provided within each folder shaped region, and appro- jq 
priate region clipping using the scan line mask method 
as described above insures that only those portions of 
each region which would be visible if actual folders 
were used is displayed. 

Moreover, it will be apparent to one skilled in the art jj 
that although the present invention has been described 
with emphasis on binary representations on the display 
device 34, and therefore in black and white, that appro- 
priate inversion point and scan line masking for color 
images may also be achieved. For example, to provfde £0 
the colors of red, green and blue, three inversion point 
representations of a region may be utilized, one for each 
color respectively. Thus, the presence of an inversion 
point in one color region may selectively discharge a 
color gun in a color CRT or the like for that color. 65 
Similarly, various colors could be acheived by the ap- 
propriate combination of the three inversion point rep- 
resentations of each region stored in memory. 
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No particular programming language has been indi- 
cated for carrying out the various procedures described 
above. This is in part due to the fact that not all lan- 
guages that might be mentioned are urjversally avail- 
able. Each user of a particular computer will be aware 
of the language which is most suitable for his immediate 
purposes. In practice, it has proven useful to substan- 
tially implement tlie present invention in en Assembly 
language which provides a machine executable object 
code. 

Because the ccHnputers and the monitor systems 
which may be used in practicing the instant invention 
consist of many diverse elements, no detailed program 
listings have been provided. It is considered that the 
operations and other procedures described above and 
illustrated in the accompanying drawings are suffi- 
ciently disclosed to permit one of ordinary skill to prac- 
tice the instant invention or so mtich of it as is of use to 
him. 

ThuSv methods and apparatus which are most advan- 
tageously used in conjunction with a digital computer 
to provide improved graphics capability have been 
disclosed. The present invention's use of inversion 
points and scan line masking allows any arbitrary region 
to be defined, manipulated and transferred faster and 
more efficiently than systemis previously found in the 
art 

While the present invention has been particularly 
described with reference to FIGS. 1-9 and with empha- 
sis on certain computer systems, it should be understood 
that the figures are for illustration only and should not 
be taken as limitations upon the invention. In addition, it 
is clear that the methods and appvatus of the present 
inventions has utility in any application where graphic 
representations on a CRT or other display device are 
desir:Ml. It is contemplated that many changes and mod- 
ifications may be made, by one of ordinary skill in the 
art without departing from the spirit and scope of the 
invention as disclosed above. 

I claim: 

1. A computer display system, comprising: 
display means for providing a display including a 

plurality of display elements, each of said display 
elements being selectively enabled; 

memory means for storing a plurality of inversion 
points, each of said inversion points having a coor- 
dinate corresponding to an element on said display, 
wherein the coordinates of each inversion point 
specify orthogonal lines extending ia the direction 
of subsequently enabled display elements from said 
inversion point and forming two boundaries of a 
contrasting area; 

processing means coupled to said memory means for 
enabling elements on said display which corre- 
spond to said stored inversion points, and generat- 
ing said contrasting areas on said display, the con- 
trast of an area being a function of the coordinates 
of previously displayed inversion points; 

whereby a region which comprises a plurality of 
inversion points may be displayed by enabling said 
corresponding elements and generating said associ- 
ated contrasting areas on said display means. 

2. The display system of claim 1 wherein said display 
means includes a plurality of raster scan lines compris- 
ing said elements defining said display. 
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3. The display system of claim 2 wherein said process- 
ing means includes reading means for reading said in- 
version points from said memory in the order in which 
said elements arc scanned by said display means. 

4. The display system of claim 3, wherein said pro- 5 
cessing means includes sorting means for sorting said 
inversion points into an ordered list in accordance with 

a predetermined convention and storing said list in said 
memory means. 

5. The display system of claim 4 further including 10 
input means coupled to said processing means for input- 
ting a region to be displayed into said memory. 

6. The display system of claim 5 wherein said process- 
ing means further includes inversion point locating 
means for determining the coordinates of inversion IS 
points comprising said inputted region. 

7. The display system of claim 6 wherein said process- 
ing means further includes logic means for executing 
logic operations between ordered lists of inversion 
points defming at least two regions. 20 

8. The display system of claim 7 wherein said logic 
operations include the functions of logical AND, OR, 
NOT, and exclusive -OR. 

9. The display system of claim 7 wherein said reading 
means reads a de$^lnation bitmap within said memory 2S 
means, said destination bitmap including a plurality of 
inversion points representing regions currently being 
displayed on said raster scan display. 

10. The display system of claim 9 wherein said mem- 
ory means further includes at least one source bitmap, 30 
said source bitmap including a plurality of inversion 
points representing regions at least some portion of 
which may be transferred to said destination bitmap. 

11. The display system of claim 10 wherein at least 
one scan line buffer is defmed within said memory 35 
means, said scan line buffer being sufficiently large such 
that it contains adequate bits to represent all elerBer.ts 
disposed along a scan line of said raster scan display. 

12. TTie display system of claim 11 wherein said read- 
ing means sequentially reads inversion points in said 40 
source bitmap and provides a representation of said 
region in said scan line buffer thereby providing a scan 
of said region in said source bitmap corresponding to 
each scan line of said display means. 

13. The display system of claim 12 wherein at least 45 
one scan line mask buffer is provided within said mem- 
ory means, said scan line mask sequentially providing a 
scan of said destination bitmap such that the contents of 
said scan line mask are representative of a region stored 
within said destination bitmap in the order in which it is SO 
scanned by said display means. 

14. The display system of claim 13 further including 
comparison means for comparing the contents of said 
scan line mask and said scan line buffer, such that prior 

to the transfer of the contents of said scan line buffer 55 
from said source bitmap to said destination bitmap for 
display, the contents of said scan line buffer are com- 
pared to the contents of said mask buffer for each scan 
line position of said display means. 

15. The display system of claim 14 further including 60 
precedence control means for providing a predeter- 
mined priority as defined by a user between the contents 
of said scan line mask buffer and said scan line buffer as 
compared by said comparison means, and for transfer- 
ring portions of said scan line buffer which have prece- 65 
dence to said destination bitmap for display. 

16. Th? display system of claim IS wherein each 
region inputted into said memory means is defmed by at 



least two inversion points having the same coordinates 
in different bitmaps, each of said inversion points corre- 
sponding to a different color to be displayed on said 
display means. 

17. A method for generating and manipulating 
grcphic representations on a computer controlled dis- 
play system, said display system including a plurality of 
display elements, each of said elements being selectively 
enabl«i, comprising the steps of; 

providing memory means within said computer in- 
cluding storage for a plurality of inversion points, 
each of said inversion points having a coordinate 
corresponding to an element on said display sys- 
tem, wherein the coordinates of each inversion 
point specify orthogonal lines extending in the 
direction of subsequently enabled display elements 
from said inversion point and forming two bound- 
aries of a contrasting area; 

inputting a region comprising a plurality of inversion 
points into said memory means; 

displaying said inversion points comprising said re- 
gion by enabling said corrsponding elements on 
said display and generating said contrasting areas 
on said di^lay, the contrast of a display being a 
fimction of the coordinates of previously displayed 
points; 

whereby said region is displayed by displaying said 
inversion points comprising said region and gener- 
ating said associated contrasting areas on said dis- 
play. 

18. The method as defined by claim 17 further includ- 
ing the step of identifying and storing in said memory 
means the inversion points defming said region. 

19. The method as defined by claim 18 wherein suid 
display system includes a plurality of raster scan lines 
comprising said elements of said display. 

20. The method as defmed by claim 19 further includ- 
ing the step of reading said inversion points defming 
said region from said memory in the order in which said 
elements are scanned by said display system. 

21. The method as defmed by claim 20 wherein said 
storing step includes sorting said inversion points into 
an ordered list in accordance with a predetermined 
convention. 

22. The method as defmed by claim 21 wherein said 
sorting convention comprises sorting said inversion 
points in accordance with their coordinates, such that 
said points are sorted left to right and top to bottom 
relative to one another. 

23. The method as defined by claim 22 further includ- 
ing the step of providing a one scan line buffer defined 
within said memory means, said reading means sequen- 
tially providing a representa Jon of said region in said 
scan line buffer corresponding to each scan line on said 
display. 

24. The method as defmed by claim 23 further includ- 
ing the step of providing a one scan line mask buffer 
within said memory means, said mask buffer sequen- 
tially providing a representation of a region being dis- 
played on said display such that the contents of said 
mask buffer correspond to each scan line of said display. 

25. The method as defmed by claim 24 fiirther includ- 
ing the step of comparing the contents of said scan line 
buffer vrith the contents of said scan line mask. 

26. The method as defined by claim 25 further includ- 
ing applying a predetermined priority between the con- 
tents of said scan line buffer and said scan line mask. 
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tuch that cnly selected portions of said scan *ine buffer 
contents are displayed on said display system. 

27. A method for selectively tr&osferring daU from a 
first location m a computer memory to a second loca- 
tion in said memory, comprising the steps of: 

defining a one scan line buffer in said memory, said 
scan line bufler sequentially representing said data 
in said first location; 

deflning a one scan Une mask buffer in said memory, 
said scan line mask sequentially representing data 
in said second loc(.tion; 

sequentially comparing the contents of said scan line 
bufTer with the contents of said scan line mask prior 
to the transfer of the contents of said scan line 
buffer to said second location; 

providing a predetermined precedence as defined by 
a user between the cont'^ts of said scan line buffer 
and said scan line mask, such that only selected 
data comprising said scan line buffer having prior- 
ity is transferred to said second location; 

whereby data is selectively transferred from said first 
location to said second location. 

28. The method as defmed by claim 27 wherein said 
second location comprises a plurality of bits, each bit 25 
corresponding to an element on a display system. 

29. The method as defined by claim 28 wherein data 
in said second location is displayed on said display sys- 
tem. 

30. The method as defined by claim 29 wherein said 30 
scan line buffer sequentially represents said data in said 
first location in the order in which said data will be 
displayed on said display system. 

31. The method as defined by claim 30 wherein said 
scan line mask sequentially represents data in said sec- 
ond location in the order in which said data is displayed 
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32. The method as defined by claim 31 wherein said 
daU within each of siid locations is represenUtive of at 
least one region, said region comprising a plurality of 
inversion points each of said points having a coordinate 
corresponding to an element on said display, wherein 
coordinates of each inversion point specify orthagonal 
lines extending iii the direction of sulxequently enabled 
display elements from said inversion point and forming 
two boundaries of a contrasting area. 

33. The method as defined by claim 32 wherein the 
process of determining the location of inversion points 
defining said region includes the steps of: 

detecting horizontal line segments comprising said 
region; 

defining inversion points at coordinates correspond- 
ing to the end points of said line segments. 

34. The method as defmed by claim 33 further includ- 
ing the step of sorting said inversion points defining said 
region in accordance with a predetermined convention. 

35. The method as defined by claim 34 further includ- 
ing a process to determine if a specified point lies within 
said region, said region being defined by an ordered list 
inversion points arranged such that said inversion points 
are sorted in accordance with their coordinates left to 
right and top to bottom relative to one another, com- 
prising the steps of: 

defining at least one flag bit in said memory, said flag 
bit initially set in a first state; 

scanning through said ordered list and switching said 
flag bit to a second state in a event that an inversion 
point in said list has a vertical coordinate greater 
than or equal to the vertical coordinate of said 
specified point and a horizontal coordiate less than 
that of said specified point; 

determining the state of said flag bit 
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